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HIGH BIT DEPTH DISPLAY WITH LOW FLICKER 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The following patents and/or commonly assigned patent applications are hereby 
incorporated herein by reference: 
Patent No. Filing Date Issue Date Title 

09/370,419 Aug. 9, 1999 Spatial-Temporal Multiplexing for High Bit- 

Depth Resolution Displays 
09/413,582 Oct. 6, 1999 Non-Terminating Pulse Width Modulation for 

Displays 
FIELD OF THE INVENTION 
This invention relates to the field of display systems, more particularly to display systems 
using pulse width modulation, still more particularly to display systems using pulse width 
modulation to achieve high bit depth display. 

BACKGROUND OF THE INVENTION 
The fundamental technology of cinema film projection largely has remained unchanged 
for over one hundred years. A filmstrip containing a series of images is passed through a 
powerful light beam at 24 frames per second. The light passing through the filmstrip is shuttered 
twice to produce two images of each frame. After each image is shuttered twice, the film is 
advanced to the next image and the shuttering repeated. The result is a 48Hz image sequence 
produced by a 24 frame per second source. While this produces a pleasing image while limiting 
the amount of film used to produce a movie, the frame rate is insufficient to eliminate flicker 
during bright image sequences. 
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Recently, new technologies have emerged to challenge film distribution and projection. 
These new technologies use micromirror or liquid crystal spatial light modulators to spatially 
modulate light using digitized image data. In many cases, these technologies provide superior 
image quality while greatly reducing film distribution costs and eliminating the image 
5 degradation that occurs due to the wear and tear associated with traditional film projection. 

Some of these new technologies operate digitally — that is, each pixel of the modulator is 
either on or off, fully illuminating, or not illuminating, a corresponding image pixel. Digital 
modulators produce gray scale images by temporally alternating between the on and off states 
and using a receptor such as the human eye to integrate the light received from each pixel over a 
10 given time. In a similar manner, some display systems sequentially produce three single color 
images which are combined by the viewer to achieve the perception of a three-color image. 

One of the difficulties encountered using digital spatial light modulators is the provision 
of sufficient bit depth. Images digitized to bit resolutions of only 8 or 9 bits per color per pixel 
can produce false contouring artifacts — perceived as display regions having a constant intensity 
15 with a sharp change in intensity to the next region, instead of the intended gradually changing 
intensity through the various regions. These objectionable contouring artifacts can be eliminated 
by increasing the number of data bits used to represent each pixel. Unfortunately, increasing the 
number of image bits increases the necessary system bandwidth. Furthermore, the least 
significant bits (LSBs) of the image have such short display times that the system cannot load the 
20 next bit of data into to modulator during the bit display period. 

The display period for each bit also depends on the frame rate of the display. Slower 
frame rates allow longer frame periods and enable greater bit depths. The slower frame rates, 
however, are prone to flickering. Higher frame rates eliminate flicker, but limit the bit depth of 
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the image since the display time of the LSBs becomes shorter than the modulator load time. 
What is needed is a method and system that allows both a high frame rate to eliminate flicker, 
and sufficiently long data display periods. 
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SUMMARY OF THE INVENTION 

Objects and advantages will be obvious, and will in part appear hereinafter and will be 
accomplished by the present invention which provides a method and system for low flicker 
projection of high bit depth images from low frame rate sources. One embodiment of the 
5 claimed invention provides a method of displaying image data bits in a pulse width modulated 
display system. The method comprises the steps of: receiving an image data word for an image 
pixel, the image data word comprised of at least a first and second image data bit; dividing an 
image frame period into at least two refresh periods; displaying the first image data bit during 
some, but not all, of the refresh periods; and displaying the second image data bit during more of 

10 the refresh periods than the first image data bit was displayed during. 

According to a second embodiment of the present invention, a method of allocating a 
frame period to image data bits is provided. The method comprises the steps of: dividing a 
frame period into at least two refresh periods; allocating a display period to each image data bit 
in an m-bit image data word; determining the a minimum temporal frequency for each of the 

1 5 image data bits, the minimum temporal frequency being necessary to prevent each image data bit 
from appearing to flicker; and displaying each image data bit in enough of the refresh periods to 
achieve the minimum temporal frequency, wherein not all of the image data bits are displayed in 
all of the refresh periods. 

According to a third embodiment of the present invention, a display system is provided. 

20 The display system comprises: a controller for receiving image data and processing the image 
data, the image data comprised of m image bits for each pixel of an image, the processing 
allocating a series of refresh periods to the image bits such that not all of the image bits are 
displayed in the same number of refresh periods; and a display device in electrical 
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communication with the controller, the display device for providing a modulated light beam to 
each of an array of image pixels, the modulation in response to the processed image data from 
the controller. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention, and the advantages thereof, 
reference is now made to the following descriptions taken in conjunction with the accompanying 
drawings, in which: 

5 FIGURE 1 is a plot of the output intensity of a sinusoidally varying light source. 

FIGURE 2 is a plot of the contrast sensitivity measurement over a range of temporal 
frequencies. 

FIGURE 3 is a plot of display intensity over time for a refresh period comprised of a 
single light pulse. 

10 FIGURE 4a is a plot of a single 24 Hz frame period showing the shutter period of a 

camera. 

FIGURE 4b is a plot of a single 24 Hz frame period showing the shutter period for a 
single-shuttered projector. 

FIGURE 4c is a plot of a single 24 Hz frame period showing the shutter period for a 
1 5 double-shuttered proj ector . 

FIGURE 4d is a plot of a single 24 Hz frame period showing the shutter period for a 
quadruple-shuttered projector. 

FIGURE 5a is a timeline showing the division of the operating refresh period into bit 
segments. 

20 FIGURE 5b is a timeline showing the division of the bit segments of Figure 5a used to 

display certain image data. 

FIGURE 5c is a timeline showing the division of the bit segments of Figure 5a used to 
display certain image data. 
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FIGURE 6a is a timeline of a single 24 Hz frame period showing the two refresh periods 
produced by a double-shuttered film projector. 

FIGURE 6b is a timeline of a single 24 Hz frame period showing the two refresh periods 
produced by a PWM display system replicating the image data twice. 
5 FIGURE 6c is a timeline of a single 24 Hz frame period showing the four refresh periods 

produced by a PWM display system replicating the image data four times. 

FIGURE 7 is a plot of the contrast sensitivity measurement over a range of temporal 
frequencies showing the contrast sensitivity of various bit durations at various frequencies. 

FIGURE 8 is a plot showing the maximum flicker-free bit time for full-field and 1/16* 
10 field images over a range of bit rates. 

FIGURE 9 is a plan view of a 3 x 9 array of image pixels showing a first bit mask used 
for spatial temporal multiplexing. 

FIGURE 10 is a plan view of the 3x9 array of image pixels of Figure 9 showing a 
second bit mask used in conjunction with the bit mask of Figure 9. 
1 5 FIGURE 1 1 is a plan view of the 3 x 9 array of image pixels showing the decimal value 

for each pixel in the array. 

FIGURE 12 is a plan view of the 3 x 9 array of image pixels showing the duty cycle for 
each of the three spatial-temporal bits used to represent the intensity value shown in Figure 11, 

FIGURE 13 is a plan view of the 3 x 9 array of image pixels showing the binary data 
20 used during a first refresh period to display the LSB of the intensity data shown in Figure 1 1 . 

FIGURE 14 is a plan view of the 3 x 9 array of image pixels showing the binary data 
used during a second refresh period to display the LSB of the intensity data shown in Figure 11. 
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FIGURE 15 is a plan view of the 3 x 9 array of image pixels showing the binary data 
used during a first refresh period to display the middle bit of the intensity data shown in Figure 
11. 

FIGURE 16 is a plan view of the 3 x 9 array of image pixels showing the binary data 
used during a second refresh period to display the middle bit of the intensity data shown in 
Figure 1L 

FIGURE 17 is a plan view of the 3 x 9 array of image pixels showing the binary data 
used during a first refresh period to display the MSB of the intensity data shown in Figure 11. 

FIGURE 18 is a plan view of the 3 x 9 array of image pixels showing the binary data 
used during a second refresh period to display the MSB of the intensity data shown in Figure 1 1 . 

FIGURE 19 is a timeline showing the location of certain bits in some but not all refresh 
periods according to one embodiment of the present invention. 

FIGURE 20 is a schematic view of a micromirror-based projection system utilizing the 
independent display of bit planes according to one embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A new data projection technique and system have been developed that allow pulse width 
modulated display systems to produce high bit depth images from low frame rate source material 
without appreciable flicker. One embodiment of this technique enables a micromirror-based 

5 display system to achieve an effective bit depth of 13.8 bits while displaying 24 Hz source 
material and avoiding flicker. A key to this achievement is the realization that the frame rate 
necessary to avoid flicker increases as the brightness of the image increases, and that the various 
bits of image data can be displayed at various frame rates. As a result, the most significant bits 
of image data — which represent the brightest portion of the image — can be displayed at a higher 

10 effective frame rate than the lower bits of data. 

The present invention will be discussed in terms of systems using binary data in which 
each data bit is displayed in order of significance during a single display period. It should be 
understood that the same teachings are also applicable to display systems that display each bit 
using one or more display periods arranged in any order during an image frame. Likewise, the 

15 teachings of the present disclosure are also applicable to image display systems that use non- 
binary image bit values, and to systems that vary the intensity of light during a frame. 
Image Flicker: 

Flicker is an artifact where the image seems to flash rather than retain a steady 
brightness. The study of the phenomenon of flicker was stimulated at the end of the nineteenth 
20 century with the introduction of motion picture films and again in the twentieth century with the 
introduction of television. Ferry and Porter studied the frequency of repetition necessary to 
achieve steady brightness. Ferry and Porter found that the frequency at which flicker can be 
observed increased linearly with the logarithm of luminance (known as the Ferry-Porter Law). 

Tl-28454 - Page 9 



The frequency at which the modulated source becomes steady is known as the critical flicker 
frequency (CFF). 

A modern approach to the analysis of the flicker phenomena uses the principles of linear 
system analysis and Fourier analysis techniques. The source light output can be modeled using a 
5 sine wave. Figure 1 shows the intensity 102 of a sinusoidally varying light source whose 
response over time obeys the following equation: 

/(/) = X Q * [l + m * sin(wtf)] 

where T 0 = T f *( l + y cR )/ 2 

CR = X f/Tb * s ^ e contract ra ti° °f the source 
fjfUO J 1 is the maximum brightness of the source 

2 J* is the minimum brightness of the source 

Hi The source's amplitude is controlled by the parameter 'm' where 0 < m < 1. 

O Additionally, the illuminance of the source is measured in Trolands (td). The Troland is defined 
in order to measure the illuminance at the surface of the retina of the eye. The Troland is thus 

Jf 15 calculated as the product of the light source luminance (cd/m 2 ) and the area of the pupil (mm 2 ). 

A model of the eye's temporal response can be found in "Contrast Sensitivity of the 
Human Eye and Its Effects on Image Quality," by Peter Batten. Barten has developed an 
extensive model that has proven able to match a large body of data collected on the eye's 
temporal and spatial responses. The model computes a contrast sensitivity measure, S(w), based 
20 on a number of inputs including target size, adaptation level, and the eye's integration time. The 
CFF is defined as the frequency, w, at which S(w) = 1/m. 
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This model of temporal contrast sensitivity will be used for the remainder of our analysis. 
Details of the model may be found by consulting Barten's book. 

Figure 2 shows a plot of S(w) 200 as a function of frequency. No flicker is perceived 
when a light source exhibits a modulation value (1/m) above the curve S(w). Flicker is 
5 perceived, however, if the modulation value is below the curve. Figure 2 assumes the values 
shown in Table 1 . 



Table 1. Assumed Parameters in Barten Model of Figure 2 





Paramete 
r 


Description 


Value Used 




a 


aspect ratio 


1.85 




W 


screen width 


50 ft. 




b 


distance from screen (in screen heights) 


2 




L f 


full brightness luminance level 


12 fL 




Xo 


target width 


50 degrees 




Y 0 


target height 


28 degrees 



The S(w) curve is useful in the design of projection systems because if any frequency 
components of the light projection lines within this curve, the viewer will perceive flicker. The 
10 goal is to project a light waveform that has no frequency components inside the curve. 

One more element, however, is necessary to the analysis. As the oscillating target 
reduces in size, the curve moves down. In other words, a constant full white screen oscillating 
about mean intensity To does not have the same flicker threshold characteristics as a smaller 
object on the screen oscillating at the same mean intensity. Figure 2 shows a second plot of S(w) 
15 202 that represents an oscillating target 1/1 6 th the area of the original target. This second plot 
202 represents video content typical of that contained in motion pictures. The full screen plot 
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200 represents the worst case for flicker, while the smaller target plot 202 represents a more 
typical case. 

A typical display system, however, does not use sinusoids to create an output. Projection 
system using a micromirror as the modulation device, for example, generate output consisting of 
5 pulses of light. Figure 3 shows an example of a single pulse of light for each given frame time. 
The pulse is characterized as having a duration of x seconds within a frame period of T seconds. 
In order to use the Barten model, this pulse must be characterized using a Fourier series. The 
frequency of interest is the first harmonic, which exists at the frequency of the frame rate. This 
term can be used to compute the value of m. 

%n 4*(CR-l) . (n-r\ 

01 7T * (Ci? + 1) { T J 

' % 4 where T is the frame time (sec.) 

x is the pulse duration (sec.) 

O CR is the contrast ratio 

H The CFF can now be computed for the pulses of light generated by film and by PWM displays. 
□15 This is accomplished by computing the value of m based on the pulse duration (x), frame time 
(T), and contrast ratio (CR) of the display. This value of m can then be compared to the 
temporal contrast sensitivity function, S(w), to determine if flicker will be perceived. 
Film Projection and Flicker: 

Film is recorded at 24 Hz in order that as it is projected, it will give the appearance of 
20 continuous motion. Figure 4a illustrates the shutter period 402 of a camera operating a 24 Hz. If 
film were projected at significantly lower rates, for example 10 Hz, a viewer watching an object 
moving across the screen would perceive distinct static images rather than perceive the object as 
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moving. At 24 Hz, which is comfortably above the perceived motion threshold, the viewer 
perceives an object moving rather than a series of static images. 

Simple 24 Hz projection as shown in Figure 4b, however, would not be sufficient to 
avoid flicker. To mitigate the flicker, film is projected at 48Hz, twice the rate that the film is 
5 recorded. As illustrated by Figure 4c, every recorded image of 24Hz film is shown twice using a 
double shuttering technique. This can be modeled as a 48Hz pulse waveform with an 50% duty 
cycle. 

Revisiting the temporal sensitivity model shown in Figure 2, we see that even for double- 
shutter projection (48Hz) of a full white screen, flicker easily can be seen because it is well 
10 within the flicker sensitivity curve. Point 206 marks this 48Hz frequency component of the light 
waveform 406 generated by the double shutter shown in Figure 4c. As can be seen by point 208 
in Figure 2, a quadruple shutter (96Hz), shown in Figure 4d, is needed to eliminate flicker 
altogether. 

This is the worst case analysis for film flicker, however. For typical film content, two 
15 mitigating factors must be considered. The average picture level is less than 20% of full 

brightness and the scene is made up of complex spatial image components rather than a flat field. 

These two factors allow most film content to be displayed without producing unwanted flicker. 

Thus, a viewer might not normally see flicker in film projection, but will see flicker, for 

example, in a solid bright sky scene or an animated scene with a lightly colored solid 
20 background. 

PWM Display: 

Unlike film, which generates various intensity levels with amplitude modulation, the 
DMD utilizes pulse-width modulation. The duty cycle of film projection is constant (50% in the 
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example above). The duty cycle of the DMD, however, varies from pixel to pixel to create in the 
human vision system the perception of various intensities. 

These light intensities from the DMD are produced by a process of pulse width 
modulation (PWM), in which the light is modulated over the operating refresh time. The digital 
5 video signal is converted to this PWM format. This is done by assigning each bit plane of video 
data (a bit plane is a single given bit for each pixel of an image) to a segment of time within the 
operating refresh time. Figure 5a shows the division of the operating refresh time into bit 
segments. Figures 5b and 5c illustrate how two example intensity values are generated by a 
binary PWM sequence pattern (for simplicity, only 4 bits of image data are shown). 
D 10 In the binary PWM pixel representation, a pixel's least significant bit (LSB) consumes 

f_\ l/(2 n -l) of the total refresh period, where n is the number of bits per color. The LSB+1 bit 
J consumes double the LSB time. This pattern continues for all bits of the given pixel Note in 
m Figure 5a how the LSB (bit 0) is one half the duration of bit 1; bit 1 is half the duration of bit 2; 
O and so on. The human vision system effectively integrates the pulsed light to form the 
^ 15 perception of desired intensity. The gray scale perceived is proportional to the percentage of 
y time the mirror is "on" during the refresh time. 

Taking television source as an example, we note that the source frame rate is 60Hz. To 
achieve 8 bits of resolution, the LSB for the television application would be 65jlis if it were 
displayed once per frame. The LSB+1 would have an assigned duration of twice that duration 
20 (130 (is), and so on. 

PWM Frame Replication: 

One method used in the prior art to reduce flicker in PWM display systems replicates a 
single frame of image data. For projection of film source, if we wish to match the performance 
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of film we would choose an operating refresh frequency of 48 Hz, not 24 Hz. Thus, all of the 
image bits are displayed twice as shown in Figure 6b. This method of frame replication 
functionally is the same as the method shown in Figure 6a of opening the shutter of a film 
projector twice during each image frame. Because there is no actual film that must mechanically 
5 be advanced, there is no need for an off time between frames. Thus, a bit sequence such as is 
illustrated in Figure 6b is possible. 

At a 48 Hz frame rate, PWM projection systems are susceptible to flicker. Unlike film 
display systems in which the flicker increases as the brightness increases, maximally bright 
scenes do not produce flicker as light constantly is displayed. For bright scenes less than full on, 

y 10 however, there is a strong 48Hz frequency component to the light waveform, resulting in flicker 

5* ! similar to that of film proj ection. 

J An operating refresh rate of well above 48Hz is necessary to eliminate flicker 

Ijl completely. Recalling Figure 2, a refresh rate of around 96 Hz is necessary to eliminate flicker 
Q completely (point 208 of Figure 2). A refresh rate of 96 Hz results in each bit of digital video 
r*15 being displayed four times, as shown in Figure 6c, during each frame. Lower refresh rates are 
possible, with an increasing risk of image flicker. Higher rates increase the necessary data 
bandwidth without further reducing image flicker. 

The problem, however, is that to ensure the most reliable control of the spatial light 
modulator elements, for example the mirrors on a micromirror device, the duration of each image 
20 bit must exceed a minimum bit length. For the 96 Hz refresh rate shown in Figure 6c, the LSB 
of a 12 bit image signal is 2.5 [as. While it is possible to display a bit for this short duration of 
time, LSB periods below approximately IOjis reduce the reliability of the micromirror operation 
and may require blanking periods to load the next bit plane into the mirror array. These blanking 
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periods reduce both the brightness and the contrast ratio of the image. Thus, there is a trade-off 
between operating refresh rate and length of the LSB. If the operating refresh rate is too fast, the 
LSB becomes too short. But if the operating refresh rate is too large, the result is flicker. 
Bit Independence of PWM Displays: 
5 The solution to this seemingly unavoidable tradeoff lies in the realization that each bit is 

displayed entirely independent from other bits. In other words, the display electronics system is 
designed such that bit sequences are programmable according to an independent bit-by-bit 
specification. Thus, we may display the given bits of the 24 Hz source in such a manner that the 
more significant bits can be shown at multiples of 24 Hz (48 Hz, 72 Hz, 96 Hz, or greater), while 

10 the LSBs can be shown as low as 24 Hz. 

Recalling the temporal sensitivity model, Figure 7 is a plot of the flicker sensitivity 
curve, S(oo), showing the critical flicker frequency for a full image field 702 and a smaller 1/8 
image field 704. Figure 7 also plots the contrast sensitivity of an image bit for several bit 
durations at refresh rates of 24, 48, 72, and 96 Hz. As can be seen, a 50 jaS bit flickers at a 24 

1 5 Hz refresh rate 706 but not at a 48 Hz refresh rate 708. A refresh rate of 96 Hz is bit well 
beyond the critical flicker frequency. 

Figure 7 shows that if a bit is only 10 jus, it need only be refreshed at 24 Hz to avoid 
flicker for typical partial frame movie content 704. At 48 Hz, a bit of 200 (is is right below the 
threshold of flicker. Figure 8 illustrates the same data in the form of a plot of the maximum 

20 flicker-free bit duration over frame refresh rates of 24, 48, and 72 Hz. 

To produce high bit depth, flicker-free images, each image bit is independently displayed 
at a frame rate sufficient to avoid flicker. Thus, the image bits are allowed to have different 
frame rates. For example, the LSB is shown at only 24 Hz; more significant bits are shown at 48 
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Hz; and the majority of bits are displayed at 96 Hz or greater. Table 2 is a simplified version of 
a hybrid frame rate employed in cinema quality PWM display systems. As explained below, the 
bit durations shown in Table 2 are not all multiples of two as a result of the frame rate 
differences. The refresh rates listed in Table 2 are sufficiently beyond the threshold for flicker, 
5 but each bit duration is long enough to allow efficient, consistent and reliable control of the 
micromirror device. 



Table 2. Sample Bit Durations for High Bit Depth Display 



bit 


bit segment duration (jj.s) 


operating refresh rate (Hz) 


0 (LSB) 


10.0 


24 


1 


10.0 


48 


2 


20.0 


48 


3 


20.0 


96 


4 


40.0 


96 








MSB 


>200.0 


>96 



Figure 19 shows one complete frame period 1902 comprised of four refresh periods 1904, 
10 1906, 1908, and 1910, The frame 1902 is displayed at a 24 Hz rate, which the refresh periods 
have a 96 Hz rate. Figure 19 is not to scale, and only illustrates the concept of bit independence. 
Actual bit sequences generally are not displayed in order of significance, nor are the larger data 
bits displayed as a single period. 

In Figure 19, the MSBs are displayed at a 96 Hz refresh rate by including the MSBs in 
1 5 each of the refresh periods. Bit 4 from Table 2 above is represented by 40 (iS period 1914, 
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which is displayed at a 96 Hz frame rate in each refresh period. Bit 3 is a 20 |llS period 1916 that 
is also included in each of the four refresh periods. Bit 2 is a 20 \iS period 1918 that is only 
displayed at a 48 Hz rate. Therefore, bit 2 is only included in the first 1904 and third 1908 
refresh periods each frame. Bit 1 is a 10 jiS period 1920 displayed in the second 1906 and fourth 
5 1910 refresh periods. Bit 0 is also a 10 jaS period 1922 that is only displayed in the second 
refresh period 1906. A review of Figure 19 and Table 2 shows that the fourth refresh period 
1910 is 10 jj-S shorter than the other refresh periods. 

Summing the display periods for each bit over an entire frame returns the binary 
relationship between the bits. Referring to Figure 19 and Table 2, bit 0 has a total display period 

10 of 10 \xS over the entire frame period 1902. Bit 1 has a total display period of 20 fiS over the 
entire frame period 1902. Bit 2 has a total display period of 40 jxS over the entire frame period 
1902. Bit 3 has a total display period of 80 (iS over the entire frame period 1902. Bit 4 has a total 
display period of 160 jllS over the entire frame period 1902. 
Spatial-Temporal Multiplexing: 

15 Displaying various image bits at different refresh rates avoids flicker enables the display 

of greater gray level displays for a given minimum bit duration. The number of gray levels 
possible from a given display system is increased further by the combination of the variable 
refresh rate described above and the techniques of spatial-temporal multiplexing and ternary bits. 
Spatial-temporal multiplexing is a technique used to increase the range of gray scale 

20 images, or bit depth, of a display system while maintaining an acceptable minimum bit duration. 
Spatial-temporal multiplexing applies a varying spatial mask to the image data for one or more 
of the LSB bit planes. The mask varies over time such that the on period of each pixel is limited 
over time. The viewer is unable to detect the spatial and temporal dithering. 
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For example, if the 50% checkerboard pattern of Figure 9a is used to mask the LSB for 
half of each frame period, and the 50% checkerboard pattern of Figure 9b is used for the other 
half, each LSB is only displayed half of the frame period. The human eye integrates the intensity 
of the pixel during both frame halves, in effect creating a l A LSB bit period. Of course, if the 
5 LSB of the image data for a given pixel is 0, the pixel will be off during both of the frame halves. 

Other mask patterns are used to create additional intensity levels. For example, 25% and 
12.5% patterns are possible to further reduce intensity steps without requiring shorter bit plane 
periods. 
Ternary Bits: 

D10 Yet another method of reducing the intensity step size without reducing the minimum bit 

~ I plane duration uses ternary bits planes. Ternary bit planes have three possible values. For 

J example, using spatial-temporal multiplexing, a given bit plan can have a duty cycle of 0%, 

jjl 50%, or 100%-thereby producing three different output levels. Multiple ternary bit planes allow 

O many more intensity increments than are available using binary bit planes. An example of 

HI 5 spatial-temporal multiplexing using ternary bit planes will be described in reference to Figures 9 

y through 19. 

Figures 9 and 10 are plan views of a 3x9 array of pixels showing the spatial-temporal 
masks used to provide a 50% duty cycle intensity value. Figure 1 1 is a plan view of the 3x9 
array of pixels showing a decimal value of image data for each pixel. Figure 12 shows the same 
20 array illustrating the duty cycle for each of three spatial-temporal bit plans. Assuming the 

duration of the least significant bit plane is equal to 1 LSB, the most significant bit plane has a 
duration of 9 LSBs, allowing the most significant bit plane to contribute 0, 4.5, or 9 LSBs to the 
pixel intensity. The middle spatial-temporal bit has a duration of 3 LSBs, allowing the bit plane 
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to contribute 0, 1.5, or 3 LSBs to the pixel intensity. The least significant bit plane has a 
duration of only 1 LSB and therefore contributes either 0, 0.5, or 1 LSB to the pixel intensity. 
Since 1 LSB is defined as the 100% duty cycle minimum bit plane, the minimum intensity 
increment is 0.5 LSB, not 1 LSB as would be expected. Table 3 lists the decimal value, bit plane 
duty cycles, and effective intensity for each intensity step from 0 to 26. 



Table 3. Sample Bit Plane Intensity Levels With Spatial-Temporal Multiplexing 



Decimal 
Intensity 


Bit Plane Duty Cycle 


Bit Plane Intensity (LSBs) 


Intensity 
(LSBs) 


MSB 


Middle 


LSB 


MSB 


Middle 


LSB 


0 


0% 


0% 


0% 


0.0 


0.0 


0.0 


0.0 


1 


0% 


0% 


50% 


0.0 


0.0 


0.5 


0.5 


2 


0% 


0% 


100% 


0.0 


0.0 


1.0 


1.0 


3 


0% 


50% 


0% 


0.0 


1.5 


0.0 


1.5 


4 


0% 


50% 


50% 


0.0 


1.5 


0.5 


2.0 


5 


0% 


50% 


100% 


0.0 


1.5 


1.0 


2.5 


6 


0% 


100% 


0% 


0.0 


3.0 


0.0 


3.0 


7 


0% 


100% 


50% 


0.0 


3.0 


0.5 


3.5 


8 


0% 


100% 


100% 


0.0 


3.0 


1.0 


4.0 


9 


50% 


0% 


0% 


4.5 


0.0 


0.0 


4.5 


10 


50% 


0% 


50% 


4.5 


0.0 


0.5 


5.0 


11 


50% 


0% 


100% 


4.5 


0.0 


1.0 


5.5 


12 


50% 


50% 


0% 


4.5 


1.5 


0.0 


6.0 


13 


50% 


50% 


50% 


4.5 


1.5 


0.5 


6.5 


14 


50% 


50% 


100% 


4.5 


1.5 


1.0 


7.0 


15 


50% 


100% 


0% 


4.5 


3.0 


0.0 


7.5 
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1 f 

16 


f An/ 

50% 


1 AAO/ 

100% 


Z. AO/ 

50% 


4. J 


1 A 

j.U 


A ^ 

U.j 


Q A 
o.U 


17 


50% 


1 AAO/ 

100% 


1 AAO/ 
100% 


4. J 


"J A 

J.U 


1 A 

l.U 


Q ^ 
o.J 


1 o 

18 


50% 


AO/ 

0% 


AO/ 

OYo 


4.0 


A A 

u.u 


A A 
U.U 


Q A 

y.u 


19 


100% 


AO/ 

0% 


r AO/ 

50% 


A A 

y.o 


A A 

0.0 


A ^ 
U.J 




20 


1 A AO/ 

100% 


AO/ 

0% 


1 AAO/ 

lOO/o 


Q A 

y.u 


A A 
U.U 


1 A 
l.U 


1 A A 
IU.U 


o 1 
21 


1 AAO/ 

100% 


f An/ 

50% 


AO/ 
0% 


O A 

y.u 


1 ^ 

l.J 


A A 

U.U 


1 A ^ 
1U.J 


22 


1 AAO/ 

100% 


CAO/ 

50% 


CAO/ 

50% 


A A 

y.u 


l.J 


A ^ 
U.J 


1 1 A 
1 l.U 


23 


100% 


f Aft/ 

50% 


1 AAO/ 

100% 


n a 

y.o 


1.5 


1 A 
l.U 


1 1,5 


24 


1 AAO/ 
100% 


1 AAO/ 
100% 


AO/ 

OYo 


Q A 

y.u 


^ A 

j.U 


A A 
U.U 


1 0 A 
IZ.U 


25 


100% 


100% 


50% 


9.0 


3.0 


0.5 


12.5 


26 


100% 


100% 


100% 


9.0 


3.0 


1.0 


13.0 



Figures 13 and 14 show the pixel values for two sequential instances of the LSB bit 
plane. The top row of pixels is always off in both Figure 13 and 14 since, as shown in Figure 12 
and Table 3, the LSB is not used to create any of the intensity levels of the top row of pixels. 
5 Likewise, the bottom row of pixels in Figures 13 and 14 is always on. The middle row of pixels 
in Figures 13 and 14, as indicated by Figure 12, all have a 50% duty cycle. The mask patterns of 
Figures 9 and 10 are used to determine which pixels are on during the first instance of the LSB 
bit plane (Figure 13), and which of these pixels are on during the second instance of the LSB bit 
plane (Figure 14). 

10 Figures 15 and 16 show the pixel values for two sequential instances of the middle bit 

plane. The first, fourth, and seventh columns of pixels are always off in both Figure 15 and 16 
since, as shown in Figure 12 and Table 3, the middle bit is not used to create any of the intensity 
levels in these columns of pixels. Likewise, the third, sixth, and ninth columns of pixels in 
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Figures 15 and 16 are always on. The second, fifth, and eighth columns of pixels in Figures 15 
and 16, as indicated by Figure 12, all have a 50% duty cycle. The mask patterns of Figures 9 
and 10 are used to determine which of these pixels are on during the first instance of the middle 
bit plane (Figure 15), and which pixels are on during the second instance of the middle bit plane 
5 (Figure 16). 

Figures 17 and 18 show the pixel values for two sequential instances of the MSB bit 
plane. The first three columns of pixels are always off in both Figure 17 and 18 since, as shown 
in Figure 12 and Table 3, the MSB is not used to create any of the intensity levels in these 
columns of pixels. Likewise, the seventh, eighth, and ninth columns of pixels in Figures 17 and 
10 18 are always on. The fourth, fifth, and sixth columns of pixels in Figures 17 and 18, as 

indicated by Figure 12, all have a 50% duty cycle. The mask patterns of Figures 9 and 10 are 
used to determine which of these pixels are on during the first instance of the MSB bit plane 
(Figure 17), and which pixels are on during the second instance of the middle bit plane (Figure 
18). 

1 5 Non-Terminated PWM Sequences: 

Yet another improvement to reduce flicker in low frame rate displays is the use of non- 
terminated, or hanging PWM sequences. Because the duration of each bit in a sequence has a 
precise relationship to the duration of all of the other bits, and because the minimum bit duration 
is somewhat limited as described above, the sum of all bit durations often does not exactly equal 
20 the available frame period. Many systems simply turn off all of the pixels of the modulator 

during this dead time between the end of a first bit sequence and the beginning of the next frame 
period. This dead time creates image flicker at the frame rate. Since the frame rate is fairly low, 
24 Hz in some applications, this flicker is likely to be visible even if the dead time is very short. 
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Distributing the dead time between each of the refresh periods makes the flicker much more 
difficult to detect, but in some instances the flicker is detectable. An alternative is to simply 
leave the pixels set in the state determined by the last bit plane of each frame until the beginning 
of the next frame period. This alternative alters the relationship of the bits, and slightly increases 
5 the intensity of the image compared to the practice of turning the pixels off during the dead time, 
but helps to eliminate flicker. 
Low Flicker High Bit Depth Display: 

Tables 4 and 5 detail four possible bit sequences according to one embodiment of the 
present invention. In Table 4, each of the four sequences is listed. The description is comprised 
S 10 of the number of non-STM bits (Ax), followed by the number of STM bits (Sx) used in the 
^ ; sequence. The description further lists the frame rates at which various bits of the sequence are 
J refreshed. The four sequences in Table 4 all refresh each bit at either a 96 or a 24 Hz rate. From 
m Table 4, it is seen that sequences A9S3-96/48(A) and A10S2-96/48(A) have very short minimum 
O bit plane durations (3.3 \iS and 5.0 jiS). Of the remaining two sequences, A9S3-9648(B) is 

CD 

I s * 1 5 preferred since it has the higher effective bit depth. 

y In Table 4, three values are used to represent the bit depth of the bit sequence. The 

effective bit depth represents the equivalent bit depth over the entire range of data values. The 
minimum bit depth represents the bit depth represented by the worst-case (largest) incremental 
intensity increase in the range of data values. The maximum bit depth represents the bit depth 
20 represented by the best case (smallest) incremental intensity increase in the range of data values. 



Table 4. Sample Spatial Temporal Bit Durations 



Pattern 
Description 


Bit Plane Duration 


Bit Depth 


Al 


AO 


S2 


SI 


SO 


Eff. 


Min. 


Max. 
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A9S3-96/48(A) 


22.5 




1 C A 

15.0 


1 A A 

10.0 


3.3 


1 o o 

13.8 


1 1 o 

13.8 


1 "5 O 

13.8 




ZZ.O 




1 ^ A 
1 J.U 


1 ^ 1 

1 J.J 


1 A A 

10. U 


1 J.O 


1 J.O 


14. 0 


A10S2-96/48(A) 


22.5 


11.3 


7.5 


5.0 




13.2 


13.2 


13.2 


A10S2-96/48(B) 


22.5 


11.3 


5.0 


15.0 




13.2 


13,2 


13.2 



Table 5 shows the allocation of each of the bit planes to the four refresh periods. The bit 
planes corresponding to the larger non-STM bits (A 10 through Al) are not shown in Table 5 
because they are displayed in all four of the refresh periods. 
5 Table 5. Sample Allocation of Bit Planes to Refresh Period 





Sequence 


Refresh #1 


Refresh #2 


Refresh #3 


Refresh #4 




A9S3-96/48(A) 


S2a, Sla 


S2b, SOa 


S2a, Sib 


S2b, SOb 




A9S3-96/48(B) 


S2a, Sla 


S2b, SOa 


S2a, Sib 


S2b, SOb 




A10S2-96/48(A) 


AO, S2a, Sla 


AO, S2b, SOa 


AO, S2a, Sib 


AO, S2b, SOb 




A10S2-96/48(B) 


AO, S2a, Sla 


AO, S2b, SOa 


AO, S2a, Sib 


AO, S2b, SOb 



Figure 20 is a schematic view of an image projection system 2000 using a micromirror 
2002 spatial light modulator to display bit planes independently of one another in refresh periods 
according to the present invention. In Figure 20, light from light source 2004 is focused on the 
10 improved micromirror 2002 by lens 2006. Although shown as a single lens, lens 2006 is 
typically a group of lenses and mirrors which together focus and direct light from the light 
source 2004 onto the surface of the micromirror device 2002. Image data and control signals 
from controller 2014 cause some mirrors to rotate to an on position and others to rotate to an off 
position. Mirrors on the micromirror device that are rotated to an off position reflect light to a 
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light trap 2008 while mirrors rotated to an on position reflect light to projection lens 2010, which 
is shown as a single lens for simplicity. Projection lens 2010 focuses the light modulated by the 
micromirror device 2002 onto an image plane or screen 2012. 

Thus, although there has been disclosed to this point a particular embodiment of a system 

5 and method for creating low frame rate displays without flickering it is not intended that such 
specific references be considered as limitations upon the scope of this invention except insofar as 
set forth in the following claims. Furthermore, having described the invention in connection 
with certain specific embodiments thereof, it is to be understood that further modifications may 
now suggest themselves to those skilled in the art, it is intended to cover all such modifications 

10 as fall within the scope of the appended claims. 
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WHAT IS CLAIMED IS: 

1 . A method of displaying image data bits, said method comprising the steps of: 

receiving an image data word for an image pixel, said image data word comprised 
of at least a first and second image data bit; 

dividing an image frame period into at least two refresh periods; 

displaying said first image data bit during some, but not all, of said refresh 
periods; and 

displaying said second image data bit during more of said refresh periods than 
said first image data bit was displayed during. 

2. A method of allocating a frame period to image data bits, said method comprising the 
steps of: 

dividing a frame period into at least two refresh periods; 

allocating a display period to each image data bit in an m-bit image data word; 

determining the a minimum temporal frequency for each of said image data bits, 
said minimum temporal frequency necessary to prevent each said image data bit from 
appearing to flicker; and 

displaying each said image data bit in enough of said refresh periods to achieve 
said minimum temporal frequency, wherein not all of said image data bits are displayed 
in all of said refresh periods. 

3. A display system comprising: 

a controller for receiving image data and processing said image data, said image 
data comprised of m image bits for each pixel of an image, said processing allocating a 
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series of refresh periods to said image bits such that not all of said image bits are 
displayed in the same number of said refresh periods; and 

a display device in electrical communication with said controller, said display 
device for providing a modulated light beam to each of an array of image pixels, said 
modulation in response to said processed image data from said controller. 
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ABSTRACT OF THE DISCLOSURE 

A method of and system for displaying a high bit depth pulse width modulated image at a 
low frame rate without image flicker. The frame period (1902) is divided into a series of refresh 
periods (1904, 1906, 1908, 1910). The more significant image bits (1912, 1914, 1916) are 
displayed in every refresh period, while the bits of lesser significance (1918, 1920, 1922) are 
displayed only during a subset of the refresh periods. The bits of lesser significance ideally are 
arranged out of phase with one another such that an equal, or comparable, duration of the lesser 
significant bit periods is included in each of the refresh periods. Because the minimum temporal 
frequency necessary to avoid flicker is greater for longer bit durations, this method provides a 
higher frequency for the more significant bits compared to the bits of lesser significance that are 
less likely to flicker. This provides the advantage of enabling greatly increase bit depth without 
requiring unnecessarily short bit planes. 
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Docket No. TI-28454 
COMBINED DECLARATION AND POWER OF ATTORNEY 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, and I 
verily believe that I am the original, first and sole inventor if only one name is listed below, or an 
original, first and joint inventor if plural inventors are named below, of the subject matter which is 
claimed and for which a patent is sought on the invention entitled: High Bit Depth Display With Low 
Flicker, which: 

(a) X is attached hereto. 

(b) was filed on as Serial No. . 

(c) was described and claimed in PCT International Application No. 

filed on and as amended under PCT Article 19 

on (if any). 

I have reviewed and understand the contents of the above identified specification, including the 
claims as amended by any amendment specifically referred to in the oath or declaration; 

No application for patent or inventor's certificate on this invention has been filed by me or by my 
legal representatives or assigns in any country foreign to the United States of America; 

I acknowledge the duty to disclose information which is material to the patentability of this 
application in accordance with Title 37, Code of Federal Regulations Section 1 .56(a); 

I hereby claim that benefit under Title 35, United States Code Section 120 of any United States 
applications listed below and, insofar as the subject matter of each of the claims of this application is 
not disclosed in the prior United States application in the manner provided by the first paragraph of 
Title 35, United States Code, Section 1 12, 1 acknowledge the duty to disclose material information as 
defined in Title 37, Code of Federal Regulations, Section 1.56(a) which occurred between the filing 
date of the prior application and the national or PCT international filing date of this application: 

Application No. 60/148,249, filed on August 11, 1999. 

As a named inventor, I hereby appoint the following attorneys to prosecute this application and 

transact all business in the Patent and Trademark Office connected therewith: 

Charles A. Brill, Reg. No. 37,786; 
Wade James Brady III, Reg. No. 32,080; 
Frederick J. Telecky, Jr. , Reg. No. 29,979; 
Jay M. Cantor, Reg. No. 19,906; and 
William B. Kempler, Reg. No. 28,228. 
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Send correspondence and direct telephone calls to: 
Charles A. Brill 

Texas Instruments Incorporated 
P.O. Box 655474, MS 3999 
Dallas, Texas 75265 
(972) 917-4379 

I further declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by fine 
or imprisonment, or both under Section 1001 of Title 18 of the United States Code, and that such willful 
statements may jeopardize the validity of the application or any patent issuing thereon. 
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